CLAD: A Complex and Long Activities Dataset with Rich Crowdsourced Annotations

This paper introduces a novel activity dataset which exhibits real-life and diverse scenarios of complex, temporally-extended human activities and actions. The dataset presents a set of videos of actors performing everyday activities in a natural and unscripted manner. The dataset was recorded using a static Kinect 2 sensor which is commonly used on many robotic platforms. The dataset comprises of RGB-D images, point cloud data, automatically generated skeleton tracks in addition to crowdsourced annotations. Furthermore, we also describe the methodology used to acquire annotations through crowdsourcing. Finally some activity recognition benchmarks are presented using current state-of-the-art techniques. We believe that this dataset is particularly suitable as a testbed for activity recognition research but it can also be applicable for other common tasks in robotics/computer vision research such as object detection and human skeleton tracking

Real-time motion and retrospective coil sensitivity correction for CEST using volumetric navigators (vNavs) at 7T

Purpose To explore the impact of temporal motion-induced coil sensitivity changes on CEST-MRI at 7T and its correction using interleaved volumetric EPI navigators, which are applied for real-time motion correction. Methods Five healthy volunteers were scanned via CEST. A 4-fold correction pipeline allowed the mitigation of (1) motion, (2) motion-induced coil sensitivity variations, Delta B1-, (3) motion-induced static magnetic field inhomogeneities, Delta B-0, and (4) spatially varying transmit RF field fluctuations, Delta B1+. Four CEST measurements were performed per session. For the first 2, motion correction was turned OFF and then ON in absence of voluntary motion, whereas in the other 2 controlled head rotations were performed. During post-processing Delta B1- was removed additionally for the motion-corrected cases, resulting in a total of 6 scenarios to be compared. In all cases, retrospective increment B-0 and -Delta B1+ corrections were performed to compute artifact-free magnetization transfer ratio maps with asymmetric analysis (MTRasym). Results Dynamic Delta B1- correction successfully mitigated signal deviations caused by head motion. In 2 frontal lobe regions of volunteer 4, induced relative signal errors of 10.9% and 3.9% were reduced to 1.1% and 1.0% after correction. In the right frontal lobe, the motion-corrected MTRasym contrast deviated 0.92%, 1.21%, and 2.97% relative to the static case for Delta omega = 1, 2, 3 +/- 0.25 ppm. The additional application of Delta B1- correction reduced these deviations to 0.10%, 0.14%, and 0.42%. The fully corrected MTRasym values were highly consistent between measurements with and without intended head rotations. Conclusion Temporal Delta B1- cause significant CEST quantification bias. The presented correction pipeline including the proposed retrospective Delta B1- correction significantly reduced motion-related artifacts on CEST-MRI.Peer reviewe

A probabilistic atlas of the human thalamic nuclei combining ex vivo MRI and histology

The human thalamus is a brain structure that comprises numerous, highly specific nuclei. Since these nuclei are known to have different functions and to be connected to different areas of the cerebral cortex, it is of great interest for the neuroimaging community to study their volume, shape and connectivity in vivo with MRI. In this study, we present a probabilistic atlas of the thalamic nuclei built using ex vivo brain MRI scans and histological data, as well as the application of the atlas to in vivo MRI segmentation. The atlas was built using manual delineation of 26 thalamic nuclei on the serial histology of 12 whole thalami from six autopsy samples, combined with manual segmentations of the whole thalamus and surrounding structures (caudate, putamen, hippocampus, etc.) made on in vivo brain MR data from 39 subjects. The 3D structure of the histological data and corresponding manual segmentations was recovered using the ex vivo MRI as reference frame, and stacks of blockface photographs acquired during the sectioning as intermediate target. The atlas, which was encoded as an adaptive tetrahedral mesh, shows a good agreement with previous histological studies of the thalamus in terms of volumes of representative nuclei. When applied to segmentation of in vivo scans using Bayesian inference, the atlas shows excellent test-retest reliability, robustness to changes in input MRI contrast, and ability to detect differential thalamic effects in subjects with Alzheimer's disease. The probabilistic atlas and companion segmentation tool are publicly available as part of the neuroimaging package FreeSurfer.The authors would like to thank Professor Karla Miller (Oxford) for her help with the design of the ex vivo MRI acquisition; Ms. Mercedes I~niguez de Onzo~no and Mr. Francisco Romero (UCLM) for their careful technical laboratory help; and Mr. Gonzalo Artacho (UCLM) for his help with the digitization and curation of his organization of histological data. This project has received funding from the European Union's Horizon 2020 research and innovation program under the Marie Sklodowska- Curie grant agreement No 654911 (project “THALAMODEL”) and by the European Research Council (ERC) Starting Grant agreement No 677697 (“BUNGEE-TOOLS”). It was also funded by the Spanish Ministry of Economy and Competitiveness(MINECO TEC-2014-51882-P, RYC- 2014-15440, PSI2015-65696, and SEV-2015-0490), the Basque Government (PI2016-12), and UCLM Internal Research Groups grants. Support for this research was also provided in part by the National Institute of Biomedical Imaging and Bioengineering (P41EB015896, 1R01EB023281, R01EB006758, R21EB018907, R01EB019956), the National Institute on Aging (5R01AG008122, R01AG016495), the National Institute of Diabetes and Digestive and Kidney Diseases (1-R21-DK- 108277-01), the National Institute of Neurological Disorders and Stroke (R01NS0525851, R21NS072652, R01NS070963, R01NS083534, 5U01NS086625), and was made possible by the resources provided by Shared Instrumentation Grants 1S10RR023401, 1S10RR019307, and 1S- 10RR023043. Additional support was provided by the NIH Blueprint for Neuroscience Research (5U01-MH093765), part of the multiinstitutional Human Connectome Project. In addition, B.F. has a financial interest in CorticoMetrics, a company whose medical pursuits focus on brain imaging and measurement technologies. B.F.’s interests were reviewed and are managed by Massachusetts General Hospital and Partners HealthCare in accordance with their conflict of interest policies. Data collection and sharing for this project was funded by the Alzheimer's Disease Neuroimaging Initiative (National Institutes of Health Grant U01 AG024904) and DOD ADNI (DOD award number W81XWH-12-2-0012). ADNI is funded by the National Institute on Aging, the National Institute of Biomedical Imaging and Bioengineering, and through generous contributions from the following: AbbVie, Alzheimers Association; Alzheimers Drug Discovery Foundation; Araclon Biotech; BioClinica, Inc.; Biogen; Bristol-Myers Squibb Company; CereSpir, Inc.; Cogstate; Eisai Inc.; Elan Pharmaceuticals, Inc.; Eli Lilly and Company; EuroImmun; F. Hoffmann-La Roche Ltd and its affiliated company Genentech, Inc.; Fujirebio; GE Healthcare; IXICO Ltd.; Janssen Alzheimer Immunotherapy Research & Development, LLC.; Johnson & Johnson Pharmaceutical Research & Development LLC.; Lumosity; Lundbeck; Merck & Co., Inc.; Meso Scale Diagnostics, LLC.; NeuroRx Research; Neurotrack Technologies; Novartis Pharmaceuticals Corporation; Pfizer Inc.; Piramal Imaging; Servier; Takeda Pharmaceutical Company; and Transition Therapeutics. The Canadian Institutes of Health Research is providing funds to support ADNI clinical sites in Canada. Private sector contributions are facilitated by the Foundation for the National Institutes of Health (www.fnih.org). The grantee organization is the Northern California Institute for Research and Education, and the study is coordinated by the Alzheimers Therapeutic Research Institute at the University of Southern California. ADNI data are disseminated by the Laboratory for Neuro Imaging at the University of Southern California

Volumetric parcellation methodology of the human hypothalamus in neuroimaging: Normative data and sex differences

There is increasing evidence regarding the importance of the hypothalamus for understanding sex differences in relation to neurological, psychiatric, endocrine and sleep disorders. Although different in histology, physiology, connections and function, multiple hypothalamic nuclei subserve non-voluntary functions and are nodal points for the purpose of maintaining homeostasis of the organism. Thus, given the critical importance of hypothalamic nuclei and their key multiple roles in regulating basic functions, it is important to develop the ability to conduct in vivo human studies of anatomic structure, volume, connectivity, and function of hypothalamic regions represented at the level of its nuclei. The goals of the present study were to develop a novel method of semi-automated volumetric parcellation for the human hypothalamus that could be used to investigate clinical conditions using MRI and to demonstrate its applicability. The proposed new method subdivides the hypothalamus into five parcels based on visible anatomic landmarks associated with specific nuclear groupings and was confirmed using two ex vivo hypothalami that were imaged in a 7 T (7 T) scanner and processed histologically. Imaging results were compared with histology from the same brain. Further, the method was applied to 44 healthy adults (26 men; 18 women, comparable on age, handedness, ethnicity, SES) to derive normative volumes and assess sex differences in hypothalamic regions using 1.5 T MRI. Men compared to women had a significantly larger total hypothalamus, relative to cerebrum size, similar for both hemispheres, a difference that was primarily driven by the tuberal region, with the sex effect size being largest in the superior tuberal region and, to a lesser extent, inferior tuberal region. Given the critical role of hypothalamic nuclei in multiple chronic diseases and the importance of sex differences, we argue that the use of the novel methodology presented here will allow for critical investigations of these disorders and further delineation of potential treatments, particularly sex-specific approaches to gene and drug discoveries that involve hypothalamic nuclei

A probabilistic atlas of the human thalamic nuclei combining ex vivo MRI and histology

The human thalamus is a brain structure that comprises numerous, highly specific nuclei. Since these nuclei are known to have different functions and to be connected to different areas of the cerebral cortex, it is of great interest for the neuroimaging community to study their volume, shape and connectivity in vivo with MRI. In this study, we present a probabilistic atlas of the thalamic nuclei built using ex vivo brain MRI scans and histological data, as well as the application of the atlas to in vivo MRI segmentation. The atlas was built using manual delineation of 26 thalamic nuclei on the serial histology of 12 whole thalami from six autopsy samples, combined with manual segmentations of the whole thalamus and surrounding structures (caudate, putamen, hippocampus, etc.) made on in vivo brain MR data from 39 subjects. The 3D structure of the histological data and corresponding manual segmentations was recovered using the ex vivo MRI as reference frame, and stacks of blockface photographs acquired during the sectioning as intermediate target. The atlas, which was encoded as an adaptive tetrahedral mesh, shows a good agreement with with previous histological studies of the thalamus in terms of volumes of representative nuclei. When applied to segmentation of in vivo scans using Bayesian inference, the atlas shows excellent test-retest reliability, robustness to changes in input MRI contrast, and ability to detect differential thalamic effects in subjects with Alzheimer's disease. The probabilistic atlas and companion segmentation tool are publicly available as part of the neuroimaging package FreeSurfer

Multimodal magnetic resonance neuroimaging measures characteristic of early cART-treated pediatric HIV: A feature selection approach

Children with perinatally acquired HIV (CPHIV) have poor cognitive outcomes despite early combination antiretroviral therapy (cART). While CPHIV-related brain alterations can be investigated separately using proton magnetic resonance spectroscopy

Multimodal characterization of the late effects of traumatic brain injury: a methodological overview of the Late Effects of Traumatic Brain Injury Project

Epidemiological studies suggest that a single moderate-to-severe traumatic brain injury (TBI) is associated with an increased risk of neurodegenerative disease, including Alzheimer’s and Parkinson’s disease (AD and PD). Histopathological studies describe complex neurodegenerative pathologies in individuals exposed to single moderate-to-severe TBI or repetitive mild TBI, including chronic traumatic encephalopathy (CTE). However, the clinicopathological links between TBI and post-traumatic neurodegenerative diseases such as AD, PD, and CTE remain poorly understood. Here we describe the methodology of the Late Effects of TBI (LETBI) study, whose goals are to characterize chronic post-traumatic neuropathology and to identify in vivo biomarkers of post-traumatic neurodegeneration. LETBI participants undergo extensive clinical evaluation using National Institutes of Health TBI Common Data Elements, proteomic and genomic analysis, structural and functional MRI, and prospective consent for brain donation. Selected brain specimens undergo ultra-high resolution ex vivo MRI and histopathological evaluation including whole mount analysis. Co-registration of ex vivo and in vivo MRI data enables identification of ex vivo lesions that were present during life. In vivo signatures of postmortem pathology are then correlated with cognitive and behavioral data to characterize the clinical phenotype(s) associated with pathological brain lesions. We illustrate the study methods and demonstrate proof of concept for this approach by reporting results from the first LETBI participant, who despite the presence of multiple in vivo and ex vivo pathoanatomic lesions had normal cognition and was functionally independent until her mid-80s. The LETBI project represents a multidisciplinary effort to characterize post-traumatic neuropathology and identify in vivo signatures of postmortem pathology in a prospective study